Understanding factors associated with the translation of cardiovascular research: A multinational case study approach

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.This article has been made available through the Brunel Open Access Publishing Fund.Background: Funders of health research increasingly seek to understand how best to allocate resources in order to achieve maximum value from their funding. We built an international consortium and developed a multinational case study approach to assess benefits arising from health research. We used that to facilitate analysis of factors in the production of research that might be associated with translating research findings into wider impacts, and the complexities involved. Methods: We built on the Payback Framework and expanded its application through conducting co-ordinated case studies on the payback from cardiovascular and stroke research in Australia, Canada and the United Kingdom. We selected a stratified random sample of projects from leading medical research funders. We devised a series of innovative steps to: minimize the effect of researcher bias; rate the level of impacts identified in the case studies; and interrogate case study narratives to identify factors that correlated with achieving high or low levels of impact. Results: Twenty-nine detailed case studies produced many and diverse impacts. Over the 15 to 20 years examined, basic biomedical research has a greater impact than clinical research in terms of academic impacts such as knowledge production and research capacity building. Clinical research has greater levels of wider impact on health policies, practice, and generating health gains. There was no correlation between knowledge production and wider impacts. We identified various factors associated with high impact. Interaction between researchers and practitioners and the public is associated with achieving high academic impact and translation into wider impacts, as is basic research conducted with a clinical focus. Strategic thinking by clinical researchers, in terms of thinking through pathways by which research could potentially be translated into practice, is associated with high wider impact. Finally, we identified the complexity of factors behind research translation that can arise in a single case. Conclusions: We can systematically assess research impacts and use the findings to promote translation. Research funders can justify funding research of diverse types, but they should not assume academic impacts are proxies for wider impacts. They should encourage researchers to consider pathways towards impact and engage potential research users in research processes. © 2014 Wooding et al.; licensee BioMed Central Ltd.RAND Europe and HERG, with subsequent funding from the NHFA, the HSFC and the CIHR. This research was also partially supported by the Policy Research Programme in the English Department of Health

A comparative evaluation of PDQ-Evidence

BACKGROUND: A strategy for minimising the time and obstacles to accessing systematic reviews of health system evidence is to collect them in a freely available database and make them easy to find through a simple ‘Google-style’ search interface. PDQ-Evidence was developed in this way. The objective of this study was to compare PDQ-Evidence to six other databases, namely Cochrane Library, EVIPNet VHL, Google Scholar, Health Systems Evidence, PubMed and Trip. METHODS: We recruited healthcare policy-makers, managers and health researchers in low-, middle- and highincome countries. Participants selected one of six pre-determined questions. They searched for a systematic review that addressed the chosen question and one question of their own in PDQ-Evidence and in two of the other six databases which they would normally have searched. We randomly allocated participants to search PDQ-Evidence first or to search the two other databases first. The primary outcomes were whether a systematic review was found and the time taken to find it. Secondary outcomes were perceived ease of use and perceived time spent searching. We asked open-ended questions about PDQ-Evidence, including likes, dislikes, challenges and suggestions for improvements. RESULTS: A total of 89 people from 21 countries completed the study; 83 were included in the primary analyses and 6 were excluded because of data errors that could not be corrected. Most participants chose PubMed and Cochrane Library as the other two databases. Participants were more likely to find a systematic review using PDQ-Evidence than using Cochrane Library or PubMed for the pre-defined questions. For their own questions, this difference was not found. Overall, it took slightly less time to find a systematic review using PDQ-Evidence. Participants perceived that it took less time, and most participants perceived PDQ-Evidence to be slightly easier to use than the two other databases. However, there were conflicting views about the design of PDQ-Evidence. CONCLUSIONS: PDQ-Evidence is at least as efficient as other databases for finding health system evidence. However, using PDQ-Evidence is not intuitive for some people

A translational framework for public health research

<p><b>Background</b></p> <p>The paradigm of translational medicine that underpins frameworks such as the Cooksey report on the funding of health research does not adequately reflect the complex reality of the public health environment. We therefore outline a translational framework for public health research.</p> <p><b>Discussion</b></p> <p>Our framework redefines the objective of translation from that of institutionalising effective interventions to that of improving population health by influencing both individual and collective determinants of health. It incorporates epidemiological perspectives with those of the social sciences, recognising that many types of research may contribute to the shaping of policy, practice and future research. It also identifies a pivotal role for evidence synthesis and the importance of non-linear and intersectoral interfaces with the public realm.</p> <p><b>Summary</b></p> <p>We propose a research agenda to advance the field and argue that resources for 'applied' or 'translational' public health research should be deployed across the framework, not reserved for 'dissemination' or 'implementation'.</p&gt

The use of evidence in public governmental reports on health policy: an analysis of 17 Norwegian official reports (NOU)

<p>Abstract</p> <p>Background</p> <p>Governments increasingly require policy documents to be evidence-based. This paper analyses the use of scientific evidence in such documents by reviewing reports from government-appointed committees in Norway to assess the committees' handling of questions of effect.</p> <p>Methods</p> <p>This study uses the 'Index of Scientific Quality' (ISQ) to analyse all Norwegian official reports (NOUs) that were: (1) published by the Norwegian Ministry of Health and Care Services during 1994-1998 (N = 20); and (2) concerned with questions of effect either because these were included in the mandate or as a result of the committee's interpretation of the mandate. The ISQ is based on scientific criteria common in all research concerning questions of effect. The primary outcome measure is an ISQ score on a five-point scale.</p> <p>Results</p> <p>Three reports were excluded because their mandates, or the committees' interpretations of them, did not address questions of effect. For the remaining 17 NOUs in our study, overall ISQ scores were low for systematic literature search and for explicit validation of research. Two reports had an average score of three or higher, while scores for five other reports were not far behind. How committees assessed the relevant factors was often unclear.</p> <p>Conclusion</p> <p>The reports' evaluations of health evidence in relation to questions of effect lacked transparency and, overall, showed little use of systematic processes. A systematic, explicit and transparent approach, following the standards laid down in the ISQ, may help generate the evidence-based decision-making that Norway, the UK, the EU and the WHO desire and seek. However, policy-makers may find the ISQ criteria for assessing the scientific quality of a report too narrow to adequately inform policy-making.</p

The utilisation of health research in policy-making: Concepts, examples and methods of assessment

The importance of health research utilisation in policy-making, and of understanding the mechanisms involved, is increasingly recognised. Recent reports calling for more resources to improve health in developing countries, and global pressures for accountability, draw greater attention to research-informed policy-making. Key utilisation issues have been described for at least twenty years, but the growing focus on health research systems creates additional dimensions. The utilisation of health research in policy-making should contribute to policies that may eventually lead to desired outcomes, including health gains. In this article, exploration of these issues is combined with a review of various forms of policy-making. When this is linked to analysis of different types of health research, it assists in building a comprehensive account of the diverse meanings of research utilisation. Previous studies report methods and conceptual frameworks that have been applied, if with varying degrees of success, to record utilisation in policy-making. These studies reveal various examples of research impact within a general picture of underutilisation. Factors potentially enhancing utilisation can be identified by exploration of: priority setting; activities of the health research system at the interface between research and policy-making; and the role of the recipients, or 'receptors', of health research. An interfaces and receptors model provides a framework for analysis. Recommendations about possible methods for assessing health research utilisation follow identification of the purposes of such assessments. Our conclusion is that research utilisation can be better understood, and enhanced, by developing assessment methods informed by conceptual analysis and review of previous studies

A retrospective analysis of the change in anti-malarial treatment policy: Peru

<p>Abstract</p> <p>Background</p> <p>National malaria control programmes must deal with the complex process of changing national malaria treatment guidelines, often without guidance on the process of change. Selecting a replacement drug is only one issue in this process. There is a paucity of literature describing successful malaria treatment policy changes to help guide control programs through this process.</p> <p>Objectives</p> <p>To understand the wider context in which national malaria treatment guidelines were formulated in a specific country (Peru).</p> <p>Methods</p> <p>Using qualitative methods (individual and focus group interviews, stakeholder analysis and a review of documents), a retrospective analysis of the process of change in Peru's anti-malarial treatment policy from the early 1990's to 2003 was completed.</p> <p>Results</p> <p>The decision to change Peru's policies resulted from increasing levels of anti-malarial drug resistance, as well as complaints from providers that the drugs were no longer working. The context of the change occurred in a time in which Peru was changing national governments, which created extreme challenges in moving the change process forward. Peru utilized a number of key strategies successfully to ensure that policy change would occur. This included a) having the process directed by a group who shared a common interest in malaria and who had long-established social and professional networks among themselves, b) engaging in collaborative teamwork among nationals and between nationals and international collaborators, c) respect for and inclusion of district-level staff in all phases of the process, d) reliance on high levels of technical and scientific knowledge, e) use of standardized protocols to collect data, and f) transparency.</p> <p>Conclusion</p> <p>Although not perfectly or fully implemented by 2003, the change in malaria treatment policy in Peru occurred very quickly, as compared to other countries. They identified a problem, collected the data necessary to justify the change, utilized political will to their favor, approved the policy, and moved to improve malaria control in their country. As such, they offer an excellent example for other countries as they contemplate or embark on policy changes.</p

Analysing key influences over actors' use of evidence in developing policies and strategies in Nigeria: a retrospective study of the Integrated Maternal Newborn and Child Health strategy

Background Evidence-informed policymaking has been promoted as a means of ensuring better outcomes. However, what counts as evidence in policymaking lies within a spectrum of expert knowledge and scientifically generated information. Since not all forms of evidence share an equal validity or weighting for policymakers, it is important to understand the key factors that influence their preferences for different types of evidence in policy and strategy development. Method A retrospective study was carried out at the national level in Nigeria using a case-study approach to examine the Nigerian Integrated Maternal Newborn and Child Health (IMNCH) strategy. Two frameworks were used for conceptualization and data analysis, namely (1) to analyse the role of evidence in policymaking and (2) the policy triangle. They were used to explore the key contextual and participatory influences on choice of evidence in developing the IMNCH strategy. Data was collected through review of relevant national documents and in-depth interviews of purposively selected key policy and strategic decision makers. Thematic analysis was applied to generate information from collected data. Results The breadth of evidence used was wide, ranging from expert opinions to systematic reviews. The choice of different types of evidence was found to overlap across actor categories. Key influences over actors’ choice of evidence were: (1) perceived robustness of evidence – comprehensive, representative, recent, scientifically sound; (2) roles in evidence process, i.e. their degree and level of participation in evidence generation and dissemination, with regards to their role in the policy process; and (3) contextual factors such as global agenda and influence, timeline for strategy development, availability of resources for evidence generation, and lessons learnt from previous unsuccessful policies/plans. Conclusion Actors’ preferences for different types of evidence for policy are influenced not only by the characteristics of evidence itself, but on actors’ roles in the evidence process, their power to influence the policy, and the context in which evidence is used

Research translation to inform national health policies: learning from multiple perspectives in Uganda

<p>Abstract</p> <p>Background</p> <p>Research and evidence can have an impact on policy and practice, resulting in positive outcomes. However, research translation is a complex, dynamic and non-linear process. Although universities in Africa play a major role in generating research evidence, their strategic approaches to influence health policies and decision making are weak. This study was conducted with the aim of understanding the process of translating research into policy in order to guide the strategic direction of Makerere University College of Health Sciences (MakCHS) and similar institutions in their quest to influence health outcomes nationally and globally.</p> <p>Methods</p> <p>A case study approach using 30 in-depth interviews with stakeholders involved in two HIV prevention research project was purposively selected. The study sought to analyze the research-to-policy discourses for the prevention of mother-to-child transmission (PMTCT) and safe male circumcision (SMC). The analysis sought to identify entry points, strengths and challenges for research-to-policy processes by interviewing three major groups of stakeholders in Uganda – researchers (8), policy makers (12) and media practitioners (12).</p> <p>Results</p> <p>Among the factors that facilitated PMTCT policy uptake and continued implementation were: shared platforms for learning and decision making among stakeholders, implementation pilots to assess feasibility of intervention, the emerging of agencies to undertake operations research and the high visibility of policy benefits to child survival. In contrast, SMC policy processes were stalled for over two years after the findings of the Uganda study was made public. Among other factors, policy makers demanded additional research to assess implementation feasibility of SMC within ordinary health system context. High level leaders also publicly contested the SMC evidence and the underlying values and messages – a situation that reduced the coalition of policy champions.</p> <p>Conclusions</p> <p>This study shows that effective translation of PMTCT and SMC research results demanded a “360 degree” approach to assembling additional evidence to inform the implementation feasibility for these two HIV prevention interventions. MakCHS and similar institutions should prioritize implementation research to guide the policy processes about the feasibility of implementing new and effective innovations (e.g. PMTCT or SMC) at a large scale in contexts that may be different from the research environments.</p

Utilization of a population health survey in policy and practice: a case study

BackgroundThere is growing interest by funding bodies and researchers in assessing the impact of research on real world policy and practice. Population health monitoring surveys provide an important source of data on the prevalence and patterns of health problems, but few empirical studies have explored if and how such data is used to influence policy or practice decisions. Here we provide a case study analysis of how the findings from an Australian population monitoring survey series of children&rsquo;s weight and weight-related behaviors (Schools Physical Activity and Nutrition Survey (SPANS)) have been used, and the key facilitators and barriers to their utilization.MethodsData collection included semi-structured interviews with the chief investigators (n = 3) and end-users (n = 9) of SPANS data to explore if, how and under what circumstances the survey findings had been used, bibliometric analysis and verification using documentary evidence. Data analysis involved thematic coding of interview data and triangulation with other data sources to produce case summaries of policy and practice impacts for each of the three survey years (1997, 2004, 2010). Case summaries were then reviewed and discussed by the authors to distil key themes on if, how and why the SPANS findings had been used to guide policy and practice.ResultsWe found that the survey findings were used for agenda setting (raising awareness of issues), identifying areas and target groups for interventions, informing new policies, and supporting and justifying existing policies and programs across a range of sectors. Reported factors influencing use of the findings were: i) the perceived credibility of survey findings; ii) dissemination strategies used; and, iii) a range of contextual factors.ConclusionsUsing a novel approach, our case study provides important new insights into how and under what circumstances population health monitoring data can be used to influence real world policy and practice. The findings highlight the importance of population monitoring programs being conducted by independent credible agencies, researchers engaging end-users from the inception of survey programs and utilizing existing policy networks and structures, and using a range of strategies to disseminate the findings that go beyond traditional peer review publications.<br /

Policy and practice impacts of applied research: a case study analysis of the New South Wales Health Promotion Demonstration Research Grants Scheme 2000-2006

BackgroundIntervention research provides important information regarding feasible and effective interventions for health policy makers, but few empirical studies have explored the mechanisms by which these studies influence policy and practice. This study provides an exploratory case series analysis of the policy, practice and other related impacts of the 15 research projects funded through the New South Wales Health Promotion Demonstration Research Grants Scheme during the period 2000 to 2006, and explored the factors mediating impacts.MethodsData collection included semi-structured interviews with the chief investigators (n = 17) and end-users (n = 29) of each of the 15 projects to explore if, how and under what circumstances the findings had been used, as well as bibliometric analysis and verification using documentary evidence. Data analysis involved thematic coding of interview data and triangulation with other data sources to produce case summaries of impacts for each project. Case summaries were then individually assessed against four impact criteria and discussed at a verification panel meeting where final group assessments of the impact of research projects were made and key influences of research impact identified.ResultsFunded projects had variable impacts on policy and practice. Project findings were used for agenda setting (raising awareness of issues), identifying areas and target groups for interventions, informing new policies, and supporting and justifying existing policies and programs across sectors. Reported factors influencing the use of findings were: i) nature of the intervention; ii) leadership and champions; iii) research quality; iv) effective partnerships; v) dissemination strategies used; and, vi) contextual factors.ConclusionsThe case series analysis provides new insights into how and under what circumstances intervention research is used to influence real world policy and practice. The findings highlight that intervention research projects can achieve the greatest policy and practice impacts if they address proximal needs of the policy context by engaging end-users from the inception of projects and utilizing existing policy networks and structures, and using a range of strategies to disseminate findings that go beond traditional peer review publications.<br /